CLAIMS 

What is claimed is: 

1. \ A method of processing video data comprising the steps of: 
accepting video data from a video source; and 

storing video information associated with the video data as the video data is being 
accepted, the Video information being stored as annotations to the video data. 

2. The method of claim 1, wherein the video information comprises camera 
geometry infomiation. 

3. Th4 method of claim 1, wherein the video information comprises camera 
pose information. 1 

4. The method of claim 1, wherein the video information comprises source 
identification/descriftion/illumination information. 

5. The method of claim 1, wherein the video data comprises frame data 
obtained from an encoder. 
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1 \ 6 The method of claim 1 , wherein the video source comprises a video 

2 captureuevice. 




1 7. \ The method of claim 5, further comprising gathering a current state of the 

2 frame data. 



1 8. T^e method of claim 7, further comprising comparing the current state 

2 with the camera geometry information, the camera pose information and the source 

3 identification/descViption/illuniination information of the frame data. 



1 9. The niethod of claim 8, further comprising determining differential 

2 information from a result of the comparing step. 



1 1 0. The method of claim 9, further comprising appending the differential 

2 information to the framb data. 



1 1 1. An appar; 

2 a collector config 

3 data gathered from a vide 

4 an annotator coup 

5 video data with the video 



tus comprising: 

ired to collect video information to be associated with video 
) source; and 

d to the collector, the annotator configured to annotate the 
information. 
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The apparatus of claim 11, wherein the video information comprises one 
or more oY: camera geometry; camera pose information; and source 
identificati©n/description/il lamination information. 



13. VThe apparatus of claim 12, further comprising calibration software 
configured to generate the camera geometry information for the video data as the video 
data is being gathered by the video source and provide the generated camera geometry 
information to the\collector. 



c;;i 

c;;i 



1 14. The apparatus of claim 12, further comprising pose estimation software 

2 and configured to gerierate the camera pose information for the video data as the video 

3 data is being gatheredlby the video source and provide the generated camera pose 

4 information to the collector. 



1 15. The apparatus of claim 12, further comprising an encoder configured to 

2 encode the video data arid generate frame data as an input to the annotator. 



1 16. The apparatus of claim 15, wherein the encoder forwards a current state of 

2 the frame data to a state storage device coupled to the encoder. 
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1 \ 1 7. The apparatus of claim 1 6, further comprising a comparator configured to 

2 compars the current state with the video information of the frame data. 



1 1 8. \ The apparatus of claim 1 7, further comprising a differential information 

2 generator coupled to the state storage device, the comparator and the encoder and 

3 configured to generate differential information from the result of the comparison 

4 performed by\the comparator and forward the differential information to the encoder. 



1 19. A\computer readable media containing executable computer program 

2 instructions which when executed on a digital processing system causes the system to 

3 perform a method comprising: 

4 accepting v^eo data from a video source; and 

5 storing vided information for the video data as the video data is accepted, the 

6 video information biing stored as annotation to the video data for later use. 



1 20. The computer readable media of claim 19, wherein the video information 

2 is camera geometry information. 



1 21 . The computer readable media of claim 19, wherein the video information 

2 is camera pose information. 
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1 \ 22. The computer readable media of claim 19, wherein the video information 

2 is source identification/description/illumination information. 



23. The computer readable media of claim 19, wherein the video data is a 
2 frame data obtained from an encoder. 



1 24. \ The computer readable media of claim 19, wherein the video source is a 

2 video capture device. 



1 25. \The computer readable media of claim 19, further comprising gathering 

2 current state of khe frame data. 



1 26. Th^ computer readable media of claim 25, further comprising comparing 

2 the current state With the camera geometry information, the camera pose information and 

3 the source infonrlation of the frame data. 



1 27. Tha computer readable media of claim 26, further comprising determining 

2 differential information from result of the comparing. 
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^ 1^ 1 \28. The computer readable media of claim 27, further comprising appending 

^jyyiil^ 2 the differential information to the frame data. 
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